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Abstract. The work of M. S. Livsic and his collaborators in operator theory 
associates to a system of commuting nonselfadjoint operators an algebraic 
curve. Guided by the notion of rational transformation of algebraic curves, 
we define the notion of a rational transformation of a system of commuting 
nonselfadjoint operators. 

Introduction 

The work of M. S. Livsic and his collaborators in operator theory associates 
to a system of commuting nonselfadjoint operators an algebraic curve (called the 
discriminant curve) given by a determinantal representation, see This discovery 
leads to a very fruitful interplay between operator theory and algebraic geometry: 
problems of operator theory lead to problems of algebraic geometry and vice versa. 

A natural problem in operator theory is to define properly the notion of a ratio- 
nal transformation of a system of commuting nonselfadjoint operators. This arises 
whenever one wants to study the algebra generated by a given system of commut- 
ing nonselfadjoint operators. It may also allow representing the given system of 
commuting nonselfadjoint operators in terms of another system which is simpler 
in some sense (e.g., it contains fewer operators, or the operators have a smaller 
nonhermitian rank). A related problem in algebraic geometry is to find an im- 
age of an algebraic curve given by a determinantal representation under a rational 
transformation. To solve this problem we constructed elimination theory for pairs 
of polynomials along an algebraic curve given by a determinantal representation. 
While our results are for polynomials in two variables, plane algebraic curves, and 
pairs of operators, the generalization to polynomials in d variables, algebraic curves 
in the d-dimensional space, and d-tuples of operators should be, for the most part, 
relatively straightforward. 

For the simplest case, when a system of operators consists of a single operator 
and the discriminant curve is a line, these problems were solved by N. Kravitsky 
using the classical elimination theory, see Our original objective was to find an 
analogue of the constructions of W in the general case. 

In the first section we formulate a problem of rational transformations of com- 
muting nonselfadjoint operators in a framework of commutative vessels, see [Jj. 

In the second section we discuss classical elimination theory and elimination 
theory along an algebraic curve. 

Partially supported by EU-network HPRN-CT-2009-00099(EAGER), (The Emmy Noether Re- 
search Institute for Mathematics and the Minerva Foundation of Germany), the Israel Science 
Foundation grant # 8008/02-3 (Excellency Center "Group Theoretic Methods in the Study of 
Algebraic Varieties" ) . 
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In the first part of Section 2 we remind classical notions and results of the 
elimination theory and describe the image of a line under a rational transformation 
via a notion of Bezout matrix. 

In the second part of Section 2 we introduce the notion of Vandermonde vector on 
a plane algebraic curve and generalize the notion of Bezout matrix. We formulate 
analogues of the results of the classical elimination theory for the elimination theory 
along a plane algebraic curve. We describe an image of a plane algebraic curve given 
by a determinantal representation under a rational transformation via the notion 
of generalized Bezout matrix. 

In Section 3 we solve a problem formulated in Section 1 using elimination theory 
along a plane algebraic curve. 

1. Statement of the problems 

In the recent years a significant progress has been made in the study of commut- 
ing non-self adjoint operators, see [7]- It turned out that associated to a system of 
commuting non-selfadjoint operators with finite-dimensional imaginary part there 
is a certain algebraic variety called the discriminant variety. Guided by the standard 
notion of rational transformation of algebraic varieties it thus becomes a natural 
problem to study rational transformations of systems of commuting non-selfadjoint 
operators, which is the goal of this section. 

To formulate the main problem more precisely, we have to introduce some nota- 
tion. We shall use the framework of commutative vessels jTj which turns out to be 
very convenient in the study of commuting non-selfadjoint operators; it generalizes 
to the multi-operator case the framework of colligations (nodes) which has been 
extensively used in the study of a single non-selfadjoint (or non-unitary) operator, 
see, e.g., [2]. 

Let H he a Hilbert space (finite- or infinite-dimensional) and let i? be a finite- 
dimensional Hilbert space. 

Definition 1.1. A commutative vessel is a collection 

F=(A„i/,<f,£;,a„7^,7r) 

where i,j = l...k,Ai:H^H are bounded linear commuting operators; 
^ is a bounded linear mapping from H to E with the adjoint mapping 
$* : E^H; o'i,7™,7i°"* '^'"^ bounded selfadjoint operators in E, such that 

cFi<^Aj - aj^Ai 
7*7 -I- i(cr,$$*crj - crj $$Vi) 

The first problem is to define properly rational transformations of the vessel. Let 
ri(?/i, . . ., y/c), . . ., n(yi, • ■ yfe) be Z real rational functions of k variables such that 
A[ =riiAi,...,Ak),...,A[ =ri{Ai,...,Ak) are defined. 

Problem 1 Given V as above, find cr,', 7^™, 7^°"* so that V = (^■, i/, 

S', (7^,7,'™, 7;°"*) is a vessel. 
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For the case k = 1 this problem has been solved by Naftali Kravitsky (see 0, 
[HI) using the notion of the Bezout matrix of two polynomials. 

As we have mentioned in the beginning rational transformations of vessels should 
be connected with rational transformations of the associated discriminant varieties. 
We proceed to state the corresponding problems restricting ourselves for simplicity 
to the case of two commuting non-selfadjoint operators {k = 2). We will denote 
7i2 = 7™j7i2* = 7°"*. We thus consider a two operator vessel 

l^=(Ai,A2,i?,$,i?,ai,a2,7",7°"*)- 
Next theorem was proved in 0. 

Theorem 1.2. 

det(yicr2 - 2/2^1 + 7") = det(?;icr2 - y2<Ji + 7°"*) 
Definition 1.3. The polynomial A{yi,y2) defined by 

^{yi,y2) = det(?;icr2 - y2(yi + 7*") = det(?/icr2 - y2(7i +7°"*) 
is called the discriminant polynomial of the vessel. 

The discriminant polynomial is an important invariant of the corresponding ves- 
sel. In particular we have the generalized Cayley-Hamilton Theorem: 

A(Ai,^2) =0 

(on the so-called principal subspace of the vessel). 

We shall assume for simplicity that A is an irreducible polynomial and denote 
by C the irreducible plane algebraic curve with the equation A = 0. C is called the 
discriminant curve. It follows from the irreducibility of A that if we shall define for 
every (yi,?/2) on C the following two subspaces of E 

E''^{yi,y2) = fcer(yicr2 -y2cri +7'") 

i?°"*(yi,2;2) = fcer(yia2-y2ai+7°"*) 

then i?*" and are line bundles on the Riemann surface X of the algebraic 

curve C . 

Definition 1.4. Let C and C he irreducible plane algebraic curves. C and C 
are called birationally isomorphic if there exist rational mappings of C into C and 
of C into C that are inverse to one another. Equivalently there exists a rational 
mapping from C to C which is one-to-one almost everywhere (i.e., except at a 
finite number of points). 

Let ri, r2 be real rational functions, such that r = (ri, r2) is a birational isomor- 
phism of an irreducible plane algebraic curve C to an irreducible plane algebraic 
curve C. Let y be a vessel with discriminant curve C and let V' be the vessel 
constructed from it in Problem 1. 

Problem 2 

1. Prove that the discriminant polynomial of V' is irreducible and that the 
discriminant curve of V' is C". 

2. Prove that E'"^ is isomorphic to i?*" and E'°"* is isomorphic to E°"* (more 
precisely isomorphic up to a certain twist; note that since C and C are birationally 
isomorphic they have the same associated Riemann surface). 
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Technical remark: If C or C have singularities than in Problem 2 we ought to 
consider only vessels whose corresponding determinant representations are maxi- 
mal, that is the dimension of E™ and E°'^^ is maximal for all singular points of the 
curve, see '3'. 

One motivation for Problem 2 comes from the case C = , that is C is a straight 
line. C" is then a rational plane curve and (ri,r2) is its Luroth (i. e. almost 
everywhere one-to-one) rational parametrization. In this case all the statements 
of Problem 2 were actually proved by Naftali Kravitsky, see jH]- An additional 
evidence is provided by the theory of functional models where one constructs at 
once the model for any operator in the ring generated by Ai and A2 , see 0. 



2. Classical elimination theory and elimination theory along a curve 
2.1. Classical elimination theory. 

2.1.1. Vandermonde vectors. Let us recall the main goal of elimination theory. 
Given n + I (nonhomogeneous) polynomials in n variables we want to find nec- 
essary and sufficient conditions (in terms of the coefficients) for these polynomials 
to have a common zero (and furthermore to determine the number of common 
zeroes, counting multiplicities, if they exist), see jH]. 

In the classical case we consider two (nonhomogeneous) polynomials in one vari- 
able. For such a pair of polynomials one may construct so called Bezout matrix. 
Entries of this matrix depend only on coefRcients of the polynomials. Determinants 
of this matrices equal to zero if and only if the polynomials have a common zero. 

We will consider classical elimination theory in a framework of Vandermonde 
vectors. This approach allowed us to give new proofs of classical results of elimina- 
tion theory for two polynomials in one variable. The advantage of this approach is 
that these proofs can be generalized for elimination theory for two polynomials in 
two variables along a plane algebraic curve, see 

Let Vn (x) be a Vandermonde vector of the length n: 



Vn{x) 



( 1 \ 



1 



Theorem 2.1. If xi,X2, . . . , a;„ are pairwise distinct then vectors 
Vn{xi), Vn{x2), ■ ■ ■ , Vn{xn) are linearly independent. 

2.1.2. Bezout matrices. 

Lemma 2.1. For every two polynomials in one variable p{x) and q{x) of degree n 
there exists uniquely determined n x n symmetric matrix B{p,q) = (&ij)"j^Q such 
thatp{x)q{y) - q{x)p{y) =Y,bijX'{x - y)yK 

Corollary 2.1. p{x)q{y) - q{x)p{y) = Vj(a;)(a; - y)B{p, q)Vn{y). 

Theorem 2.2. The dimension of the kernel of Bezout matrix of two polynomials 
p and q of degree n is equal to the number of common zeroes of these polynomials 
and I det S{p, q)\ = \ det B{p, q) \ . 



The determinant of the Bezout matrix is called a bezoutian. 
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2.1.3. Rational transformations. We will use the notion of Bezout matrix to de- 
scribe an image of C under a rational transformation. Let us consider three poly- 
nomial in one variable po (x) , pi (x) and p2 (x) . These polynomials define a rational 
transformation r : C ^ C^: by r(x) = 
Next theorem is due to Kravitsky, 

Theorem 2.3. The image of C under the rational transformation r is a curve 
given by the next determinantal representation: 

det{B{po,pi)x + B{pQ,p2)y + B{pi,p2)) = 

2.2. Elimination theory along a curve. 

2.2.1. Vandermonde vectors on a curve. It is an unfortunate fact that the easy, 
useful and beautiful constructions of the single variable case do not generalize in 
any straightforward fashion to the case of two or more variables. Some general- 
izations of the classical results using much more sophisticated algebraic techniques 
have been obtained in recent years by Gelfand, Kapranov, Zelevinsky, see and 
Jouanolou, see jSj. In [^j we followed a different, somewhat "asymmetrical" ap- 
proach. Namely, we chosed one of our three polynomials and viewed it as defining 
a plane algebraic curve. Our goal became to generalized the notion of Bezout ma- 
trix for three (homogeneous) polynomials in two variables on the curve defined by 
the third polynomial. 

To solve this problem it turns out to be essential to consider a plane algebraic 
curve given by a determinantal representation 

A(a;o, xi, 0:2) = det(xo£'o + xiDi - X2D2) 

where Dq, Di and D2 are m x m complex hermitian matrices. 

The determinantal representation of a curve provides us with an additional 
structure. In the case of a plane irreducible curve for every point of the curve 
X = {xq, xi, X2) there is a nontrivial subspace ker^xoDo + xiDi — X2D2) (one- 
dimensional, because of the irrcducibility of A(xo, xi, a;2), except at the singular 
points). We choose a vector e in this subspace. This additional structure allows us 
to define an appropriate analogue of Vandermonde vectors. Vandermonde vectors 
on a curve (equipped with a determinantal representation) is given by 



/ x^-^e \ 

Ti-2 n-2 

Xq xie Xq X2e 

Vn{x,e) ^ 

xoXi~'^e xoX2~^e 

n—l n — 2 n — 2 n— 1 

\ Xi e x^ X2e X1X2 6X2 e / 



2o-r*l+22— ^ — 1 ^ / |z|— n— 1 



It is clear that a Vandermonde vector Vn{x,e) on a curve belongs to the space 
(^m_L_Li ^ ^i^Q^Q ^ jg degree of A(xo, xi, X2). We will denote this space by Wn 
and will call it the blown up space. Unlike the classical case all the Vandermonde 
vectors on a curve generate not the whole blown space Wn but only a certain 
subspace of Wn . Let us consider a subspace 
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where jo + ji + j2 — n — 1. We will call Vn the principal subspace. It is clear 
that all Vandermonde vectors belong to Vn, that is Vn{x) € Vn for every point 
X = (a;o,a;i,a;2). 

Theorem 2.4. The dimension of the principal subspace Vn equals to nm. 

Theorem 2.5. Vandermonde vectors in zeroes of any polynomial on a curve are 
linearly independent and generate the principal subspace Vn ■ 

The blown space and the principal subspace play a key role in the elimination 
theory on a plane algebraic curve. Namely, all the constructions of the classical 
elimination theory can be formally generalized in terms of the blown spaces. After 
this formal generalization we restrict the new "blown up" constructions to the 
corresponding principal subspaces and obtain complete analogues of the classical 
results. 

2.2.2. Generalized Bezout matrices. Our goal in this paragraph is to define prop- 
erly the generalized Bezout matrix for a pair of homogeneous polynomials in three 
variables on a curve given by a determinantal representation. 

As in the previous paragraph we consider the blown space W„ and the principal 
subspace Vn- For a pair of polynomials we will determine formal analogues of 
classical Bezout matrix in Wn and then will restrict this analogue on Vn- 

Lemma 2.2. For every two homogeneous polynomials in three variables 
p{xo, xi,X2) and q{xo, xi,X2) of degree n there exist three x "^"^"^"'"•^ symmetric 

matricesl3^° = {bjf), 0^^ = [bf^] andP^'^ = (bjf) suchthatp{xo,xi,X2)q{yo,yi,y2)- 
q{xo,xi,X2)p{yo,yi,y2) = 

^ bjjx^xiyo - xoyi)y' + bjjX^{x2yo - xoy2)y^ + bjjX^{xiy2 - X2yi)y^ 

Let us define a "^"^"^"^^ m x "^"^"^"^^ m matrix B{p, q) on the space W„: 
B{p, q) = (3^^ (g)DQ + (g)Di+ /320 ^ D2. 

Let us consider the restriction of B{p, q) on the subspace generated by Vander- 
monde vectors on the curve: 

B'{p,q)=Vv^B{p,q)Vv^ 

We will call B'{p, q) Bezout matrix of polynomials p and q along the algebraic 

curve given by the determinantal representation A. 

Next useful lemma follows from the definition of the generalized Bezout matrix. 

Lemma 2.3. IfV{x) = {x^e) = {x'^x'^x'^e) and V{y) = {y'h) = {y^y\^yi^h) are 
two Vandermonde vectors on a curve then 
V^{y)B'{p,q)V{x) = {p{x)q{y) - q{x)p{y))h^e 

Theorem 2.6. The dimension of the kernel of Bezout matrix of two polynomials 
along the curve is equal to the number of common zeroes of these polynomials along 
the curve. 

Corollary 2.2. Two polynomials in two variables have common zero on a curve if 
and only if the determinant of their Bezout matrix along this curve is equal to zero. 
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2.2.3. Rational transformation of a, curve. As was mentioned in the paragraph 2.1.3 
the image of the strait hne under a rational transformation can be described via 
the notion of the Bezout matrix. In this paragraph we consider a rational transfor- 
mation of a curve given by a determinantal representation and describe the image 
of a curve via the notion of the generalized Bezout matrix. 

As before, we start from a real plane algebraic curve C defined by a homogeneous 
polynomial in three variables A(a;o, xi,X2)- 

C = {{xo,xi,X2) e : A(xo,a;i,a;2) = 0} 

and a determinantal representation of this curve: 

A(xo,a;i, .'j;2) = det(xo£'o + xiDi - X2D2) 

Let us consider three homogeneous polynomials in three variables po, Pij P2 
of degree n and an image r{C) of the curve C under the rational transformation 
r = ipo,Pi,P2): 

r(C) = {{po{x),pi{x),p2{x)) e P2 : X G C} 

To find a determinantal representation of the curve r(C) we consider three gen- 
eralized Bezout matrices: B'{po,pi), B'{pQ,p2) and B'{pi,p2). 

Lemma 2.4. The curve given by determinantal representation 
det{xoB'{pi,p2) + xiB'{po,p2) - X2B'{po,Pi)) contains r{C). 

But if a basepoint y = {yo,yi,y2) of the rational transformation r = {po,pi,p2) 
belongs to the curve C, that is if there exists a common zero of polynomials pq, 
pi and p2 on the curve, then det(a;o-B'(pi,P2) + xiB'{po,p2) - X2B'{po,pi)) = 
because B'{pi,pj)V{y) = for every i and j. 

Therefore we consider a subspace Vn of the principal subspace V„ which is per- 
pendicular to the Vandermonde vectors in basepoints and restrict generalized Be- 
zout matrices on this subspace: 

Vn =< Vniy) : Po{y) = Pi{y) ^ P2{y) = B{p,,p,) = Vv^B'{p,,p,)Vy^. 

Theorem 2.7. The curve r(C) has the determinantal representation 
det{xoB{pi,p2) -\- xiB{pq,P2) - X2B{po,pi)). 

3. Solution of the problems 
As before, we consider a two operator vessel 

y=(Ai,A2,i?,*,£;,ai,(T2,7",7''"*) 
with the discriminant curve C defined by the determinantal representation 

A(?yi , 2/2) = det(yi<T2 - y2(Ti + 7*") 
and a rational transformation 

/ ^ Pi{yi,y2) I . P2{yi,y2) 

ri{yi,y2) = —, z , r2{yi,y2) = —, z 

po{yi,y2) po{yi,y2) 

Let us define by n the maximal degree of the polynomials Po{yi,y2), Pi (2/1,2/2) 

and P2{yi,y2)- Let us homogenize all three polynomials up to the degree n. 
Thus we consider three homogeneous polynomials in three variables of degree n: 
Po{xo,xi,X2), Pi{xo,xi,X2) and P2{xo,xi,X2). 
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n(n+l) 

As in the second part of Section 2 we consider the blown space Wn = C™ ^ ^ 
the principal subspace Vn C W„ defined by formula 

and Bezout matrices of the polynomials Pj and Pk along the curve C denoted by 

B'{Pj,Pk). 
Let us define 

E' = Vn 

= PE,i<!>A»^A»^p^\AlA*))i,i, 
a[ = B'iPo,Pi) 

a'2 = B'{Po,P2) 
ym ^ B'{P,,P2) 
yout ^ 7''"+i(CTi$'$'*(T^-C7^$'$'Vi) 

V = {A[,A'^,H,^',E',a[,a'^,j"^,^'"^*) 

Theorem 3.1. V is a vessel. 

Proof If the statement of the theorem is true for the transformation defined by 
polynomials Po,Pi,P2 and for the transformation defined by polynomials po,qi,q2 
then the statement is also true for the transformation defined by polynomials 
Pa, Pi + <li,P2 + Q2- Hence, it is sufficient to prove the theorem for the transforma- 
tion defined by pairs of monomials po , x^-^ x^^ j ^\ ■^'2 ■ For monomials this theorem 
follows recursively from the identity 

x^^V^- x^v^ = xi(a;r'y2" ^ x^vT^) + K^'vT " + 

xi{x^ ^y™ — x^y^~^)yi and the fact that operators 

7i : E'^_^ E'^, Bi.^i^ ^ and T2 : E'^_^ ^ E'^, ei.^i^ ei,^i^+i preserve 

the conditions of the vessel. Theorem is proved. 

Theorem 3.2. The discriminant variety ofV contains C. 

Proof Let us consider the point A = (Ai, A2) of the discriminant curve C. 
By definition of the discriminant polynomial det(AiC72 — A2cri + 7™) = 0. Hence, 
there exist a non-zero vector (j> such that {Xi(T2 — A2(Ti -I- 7")^ = 0. 
Let us consider the birational transformation r = (ri,r2) of a vessel 
A = (Ai, A2, H, (f), C", (Ti, (72, 7»", 7°"*) as above. It follows from 
the Theorem 3.1 that A' = (A'l, A'2, ff, <^', C"', crj , cr^, 7'", 7'°"*) is a vessel. 
By definition of a vessel a2(f)'\'i — ai(f)'X'2 + 7™(/'' = 0. Therefore 
det(Aif72 — A2cr^ +7'" = and the point A' = (r"i(A), r"2(A)) belongs to the discrim- 
inant variety of V' . The theorem is proved. 

We obtained a solution of problem 1. But if a basepoint of the rational transfor- 
mation n , r2 belongs to the discriminant curve of the vessel V then the discriminant 
variety of the vessel V' is the whole plane. That is if there 
exist a point A = (Ai, A2) such that det(A2cri — Aicr2 -|- 7) = and 
Pi{\) = 0, i = 0, 1, 2, then for every y = (j/i, t/2) det(y20-i - yW^ + 7') = 0. 
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Therefore, as in Section 2, part 2, paragraph 3, we consider 



E" 


= < {X'^'Xie)i,,, : Pn{X) = 0, (Aaai - Aiaa +7)e = >^= K 




= Ve"^' 


< 


= Pe"<j[Ve"=B{Po,Pi) 




= rE"<T'2VE" = B{Po,P2) 




= PE'n""PE" =B{P,,P2) 




= Ve"i""''Pe" 


V" 


= {A\,A'2, H, E", a'l, a'l 7"", y'°"*) 



Next theorem follows from lemma 2.4. 

Theorem 3.3. V" is a vessel and the discriminant variety ofV" contains C. 

It follows from corollary 2.2 that det cr^ = if and only if the polynomials po 

and Pi have a common zero on the curve C and that det 7' = if and only if the 
polynomials pi and p2 have a common zero on the curve C. This fact implies next 
two theorems. 

Theorem 3.4. Discriminant variety ofV" is C. 

Theorem 3.5. E^" is isomorphic to E"^^ and E"^* is isomorphic to E"""**. The iso- 
morphism maps the vectors e G E^^{Xi, A2) to the vectors {X\^ \'^2 ^)o<ii+i2<n G £""" 
and the vectors e e £;''"*(Ai, A2) to the vectors (A^^ A*'e)o<ii+i2<n G 
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